L 2 AND HP BOUNDEDNESS OF STRONGLY SINGULAR OPERATORS AND 
OSCILLATING OPERATORS ON HEISENBERG GROUPS 
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Abstract. In this paper we establish sharp L 2 and H p boundcdness results for strongly singular 
operators and oscillating operators on Heisenbcrg groups. 

1. Introduction 

The setting of this paper is the Heisenberg group H™, a£K*, realized as M 2 " +1 equipped with 
the group law, 

T 




(x, t) ■ (y, s) = (x + y,s + t — 2ax Jy), J = 

This group is equipped with the following anisotropic dilations, 

A • (x, t) = (Xx, X 2 t), A>0. 
For K e 2?'(H") we denote by Tk the convolution operator defined by K, i.e, 

T K f(x,t):=K*f(x,t) = [ K({x,t)-(y,s)- 1 )f{y, S )dydx, f e Cg°(HS). 

We say that the operator Tk is bounded on L p (M n ) if there exist a C > such that 

||Tx/|| p < C||/|| P) for all / e C7 °°(H^). 
A natural quasi-norm on the Heisenberg group is given by 

P {x,t) = {\x\ i + t*yi\ (M)eH™. 

This quasi-norm satisfies p{\- (x, t)) — Xp(x, t). For this quasi-norm, we define the strongly singular 
kernels, 

K a ^(x, t) = p(x, ty^+^e^^xipix, t)), a > 0, (3 > 0, 

where x lS a smooth bump function in a small neighborhood of the origin. This operator was 
introduced by Lyall [13] who showed that Tjc a « is bounded when a < n/3. This result was 
obtained by using the Fourier transform on the Heisenberg group in combination with involved 
estimates on oscillatory integrals. Subsequently, Laghi-Lyall |10| obtained sharp results in the 
special case a 2 < Cp (where Cp is given by by using a version for the Heisenberg group of 

the L 2 -boundedness theorem for non-degenerate oscillatory integral operators of Hormandcr [9]. 
In this paper, wc shall consider the cases a 2 > Cp and obtain sharp conditions using the theory 
for oscillatory integral operators with degenerate phases (see Section 2). Recall that the theory 
of the degenerate oscillatory integral operators was developed in depth to study X-ray transforms 
(see, e.g., Greenleaf-Seeger [7]). 
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Strongly singular convolution operators were originally considered on E". Such operators corre- 
spond to suitable oscillating multipliers. They were first studied, by Fourier transform techniques, 
in the Euclidean setting with p(x) = \x\ by Hirschman [8] in the case d = 1, and in higher dimen- 
sions by Wainger [21], Feffcrman [3], and Fefferman-Stein [4j. 

Similar kind of convolution operators with kernels of the form ^ e l \ x \ fi , a, (3 > 0, were in- 
troduced by Sjolin [T71 [TH1 US] ■ Such kernels have no singularity near the origin, but they assume 
relatively small decaying property at inhnity. Notice that the case /3 = 1 corresponds to the kernel 
of Bochner-Riesz means. For (3 ^ 1, the (L p ,L q ) estimates and Hardy space estimates hold (see 
Miyachi [T4], Pan-Sampson [16] and Sjolin [T71 [TH1 OS])- The difference between the two cases 
comes from the fact that the phase kernel \x — y\P is degenerate only if f3 = 1. In this paper, we 
also consider the analogous problem on the Heisenberg groups for the following kernels, 

L a , (x, t) = p(x, t)-^ n+2 -^e lp ^\(p(x, ty 1 ), p > 0. 

We denote by T^ a _ the group convolution operators with the kernel L a ^. In the literature, the 
operators Tk„ b (resp., T^ a „) are called strongly singular operators (resp., oscillating convolution 
operators). 

In the first part of this paper, we shall find the optimal ranges of a and /3 where the convolution 
operators associated with K a .p and L a .p are bounded on L 2 (H"). 

For a 2 > C/3, the phase doesn't satisfy the non-degeneracy condition anymore. Therefore, we 
need to deal with oscillatory integral operators with degenerate phases. A theory for this kind 
of operators has been dcvcloppcd by considering various conditions on phase functions to give 
different decaying properties (see [7]). We shall rely on the results of Greenleaf-Seeger [6] and 
Pan-Sogge [15] ■ To use such theory we shall carefully investigate the folding type for our phases. 
Interestingly enough, we have different folding types according to the values of the parameters a 
and f3. Before stating our results, we recall the previous results of Laghi-Lyall [10] and Lyall |13j . 
Set 

(1.1) ^ = ^(2/3 + 5+^(2,3 + 5)2-9). 

Then wc have 

Theorem (Laghi-Lyall [10], Lyall [13]). 

(1) T KaB is bounded on L 2 (H") if a < n/3. 

(2) IfO < a 2 < Cp, then T Kafi is bounded on L 2 (U™) if and only if a < (n + l/2)/3. 

The first main result of this paper gives sharp L 2 boundedness results for Tx a g when a 2 > Cp. 
Theorem 1.1. 

(1) If a 2 > Op, then Tx a B is bounded on L 2 (H") if and only if a < (n + \)fi- 

(2) If a 2 = Op, then Tx a B is bounded on L 2 (H") if and only if a < (n + \)fi. 

For the operators „ , wc also have the sharp L 2 boundedness results except when j3 = 1 and 
= 2. 

Theorem 1.2. 

(1) If < P < 1, then T^ a B is bounded on I? if and only if one of the following condition 
holds. 

(i) a 2 < Cp and a < (n + ^)(3, 
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(ii) a 2 = Cp and a < (n + \)(3, 

(iii) a 2 > Cp and a < (n + |)/3. 

(2) If 1 < P < 2, then p is bounded on L 2 if and only if a < (n + \){3- 

(3) If 2 < f3, then T^ a „ is bounded on L 2 if and only if ex. < (n + \)(3. 

In [10] Laghi-Lyall reduced the boundedness problem for operators on the Heisenberg group to 
that for the local operators and used a version of Homander's L 2 -boundedness theorem on the 
Heisenberg group. However, as we shall show, we may view the operators on the Heisenberg group 
as operators on Euclidean space R 2n+1 . This will enable us to use the oscillatory integral estimates 
of Greenleaf-Seeger [5] and Pan-Sogge [TS] on Euclidean space. 

For the cases (3 = 1 or (3 = 2, we also can obtain the sharp results for some value a where the 
phase becomes non-degenerate or has folds of type 2. However, in these cases, higher order types 
of folds than 3 appear for some values of a and the degenerate oscillatory integral estimates have 
not been obtained optimally yet for these cases. The theory have been established optimally only 
for phases with one or two types of folds (see Greenleaf-Seeger [6] and Pan-Sogge [15]). 

For p > 1, IP boundedness can be obtained by interpolation between the L 2 boundedness 
estimates and some L 1 boundedness estimates for dyadic-piece operator. We refer to Laghi p~0| 
Theorem 5] for the case a 2 < Cp except the endpoint. Using this typical interpolation technique, 
it is also possible to obtain the IP boundedness in the case a 2 > Cp. 



Theorem 1.3. 

(1) If a 2 > Cp, then T Ka fi is bounded on L P (H") if a - (n + \)[3 < 2/3(n + ±) 

(2) If a 2 = Cp, then T Koi fi is bounded on LP(W%) if a - (n + < 2/3(n + ±) 

Theorem 1.4. 

(1) If < f3 < 1, then Tl o „ is bounded on L P (H") if one of the following holds. 

(i) a 2 < Cp and a - (n + \)j3 < 2f3(n + \) 

(ii) a 2 = Cp and a- (n + \)/3 < 2/3{n + ±) 



(iii) a 2 < Cp and a - (n + |)/3 < 2/3(n + ±) 



(2) Ifl<f3< 2, then T L<xp is bounded on L P (H; 1 ) if a - 2{n + \)f3 < 20(n + ±) 

(3) If 2 < /3, then T Laff ts bounded on i p (H") if a- 2(n + ±)/3 < 2/3(n + |) 



In the second part of this paper, we turn our attention to the boundedness on Hardy spaces H p 
(p < 1) of the operators Tx a $ and T^ a „ . 

For the analogous operators on R", the boundedness on Hardy spaces was proved up to the 
endpoint cases by Sjolin |17[ll9j. In this case, the operator can be thought as a multiplier operator 



Tf = (mf) and we have the relation c p ^" =1 H-Rj/Hlp < < CpSj=i ll^i/lli p an< i we see 

that derivatives of the symbol -||j-m(£) of the multiplier Rjm(D) arc pointwiscly bounded by the 
derivatives of the symbol m(£). These things make it possible to calculate the H p norm accurately 
to obtain the sharp boundedness result including for the endpoint cases (see Miyachi |14|). 

The above outline seems difficult to adapt to the Heisenberg group. Instead we shall rely on 
the molecular decomposition for Hardy spaces. 

Theorem 1.5. Let p G (0, 1) and let a and f3 be real numbers such that (i — l)(2n + 2)f3 + a < 0. 
Then 
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(1) The operator TK a « is bounded on H p space. 

(2) For P ^ I, the operator T^ a . is bounded on H p space. 

These conditions are optimal except for the endpoint case (- — l)(2n + 2) ft + a = 0. 

This paper is organized as follows. In Section 2, we reduce our problem on the Heisenberg group 
to a local oscillatory integral estimates on Euclidean space. In Section 3, we recall some essential 
results for the oscillatory integral operators with degenerate phase functions and study geometry 
of the canonical relation and projection maps associated with the phase functions of the reduced 
operators, which will complete the proof of Theorem 11.11 and Theorem 11.21 In section 4, we recall 
some background on hardy spaces on the Heisenberg group and its basic properties. In section 5, 
we prove Theorem II .51 In Section 6, we show that the conditions of Theorem 11.51 are sharp except 
the endpoint cases. 

Notation 

We will use the notation < instead of < C when the constant C depends only on the fixed 
parameters such as a, a, f3 and n. In addition, we will use the notation A ~ B when both inequalities 
A < B and A > B hold. 

2. Dyadic decomposition and Localization 

In this section we reduce our problems to some oscillatory integral estimates problem on Eu- 
clidean space M. 2n+1 . This reduction is well-known for operators on Euclidean space (see Stein 
[20]). The issue of this reduction on the Heisenberg group is to control the localized operators 
fj ' in (|2.6j) uniformly for (gk,gi) such that p(g^ ■ g7 l ) < 2. Note that the cut-off functions 
T~i(p((x, t)- gZ )) n(p((y, s) ■ g7 )) have no uniform bound for their derivatives. Nevertheless we get 
the uniformity after a value-preserving change of coordinates (see (|2.8jl ). 

We decompose the kernels K a ^ and L a ^ as 

oo 

(2-1) K a ,p(x,t)=Y / K,P> Klp-v(2 3 P (x,t))K a ^x,t), 

3=1 

and 

oo 

(2-2) L a jj(x, t) = J2 L 3 atfj , L 3 a p := if{2~ 3 p{x, t))L a ,p(x, t), 

where n £ C^°(IR) is a bump function supported in [^,2] such that SJlo r ?(2-' r ) = 1 for all 
< r < 1. For notational convenience, we omit the index a and (5 from now on. 
Set Tjf = K 3 a j3 * / and S 3 f = L j a j3 * /. Then we have 

Lemma 2.1. For each N £ N, there exist constants Cm > and cp > such that 
(2.3) ||T/1> + \\TjTp \\ L ^ L i < C N 2- max ^ N 

\\S*S r \\ L ^ L , + \\S 3 S*,\\ L 2^ L2 < c N 2- ma ^-^ N 
holds for all j and j' satisfying \j — j'\ > cp. 

Proof. The proof follows from the integration parts technique in the typical way, so we omit the 
details. See Lyall [131 Lemma 2.4] where the proof for Tj is given. □ 
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By Cotlax-Stein Lemma, we only need to show that there is a constant C > such that 

11^11^3 + \\S j \\ L ^ L *<C VjeN. 

We consider the dilated kernels 
(2.4) 

Lip(x,t) =L^(2-i ■ (x,t)) = rM*,m- KQ - a) p(x,t)- Q+a e^^. 

We define Tj and Sj to be the convolution operators with kernels given by K 3 a g and L 3 a B . Set 
fj(x,t) = /(2-j • (x,t)). Then * f{2^ • (a,*)) = 2"^^ * £)(*,*), and we have ' 

ll^/!I^HI^*/(M)IU2 =2-^/ 2 ||^*/(2^'.(x,t))|U 2 

<2-^/ 2 - 2-M\\K' atfi *fj(x,t)\\v 

Similarly, we have H^/H^ < 2 J ^||,Sj||L2„ >£ 2||/|| L 2. It follows that it is enough to prove that 
\\f 3 \\ L 2^ L 2 < and \\S 3 \\ L 2^ L 2 < 

Now, we further modify our operators to some operators defined locally using the fact that the 
kernels of Tj and Sj arc supported in {(x,t) : p{x,t) < 2}. To do this we find a set of point 
G = {gk '■ k € N} such that \J kl£N B(gk 7 2) = H™ and each B(t/fc,4) contains only d„'s other gi 
members in G. 

We can split / = Y^k=i fk with each fk supported in B(gk 7 2). Define 



(2.6)f^ l f(x, t)= J K 3 a>p ((x, t) ■ (y, s)- 1 ) ■ V (p ((a, t) ■ g^ 1 )) r, (p ((y, s) ■ g' 1 )) f(y, s)dyds 
Then, 

OO 

m * f\\h {Bna) <En^*/iii 2 (s( Sfc ,2)) 



fc=i 



^E 11^7 *^Zfl\\ 2 LHB(g k a)) 



k=l 1=1 

oo 

(2.7) <En*f* E M\U(B {gkm 

k=1 {':p(9r3,T 1 )<2} 

OO 

E ii^-'iiL^n/iiii" 

< sup lU^II/llis. 

p(grg k 1 )<z 

We note that 

(2.8) det (D X;t ((x, t) -g)) = l for all g e H™. 

Then, using the coordinate change (y, s) — > ((y,s) • gk) and substituting (x,t) — > ((x,t) ■ g^) in 
, we get 



(2-9) r . . 

= / Jf^ ((x, i) • (y, s)" 1 ) 77(p(x, t)) V (p((y, s) ■ (g k ■ gf X )))/((y, s) • 5fc )dyd S . 
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Notice that p(g k ■ g x x ) < 1. Set ip ((x,t), (y, s)) = r](p(x,t))r](p((y, s) ■ (g k ■ g l 1 ))) and write / just 
for /(() • gk). Then su P p ( 9i . £ ,7 1 )< 2 11^*' II wm be achieved if we prove \\Tj ||l 2 ->l 2 ^5 2 jQ for 

(2.10) Tjf(x, t)=J K 3 a p ((x, t) ■ (y, s)- 1 ) $ ((x, t), (y, s)) f(y, s)dyds 

with a compactly supported smooth function ip. Finally we set 

(2.11) 

Bfat) =2 ja f i(x,t)e i23flp ( x < t ^, 

where p is a smooth function supported on the set {(x,t) € M. 2n+1 : i < p(x,t) < 10}. We define 
the operators L A and Lb by 



(2.12) L Aj f(x,t) = J A, {(x, t) ■ (y, s)' 1 ) ^ ((x, t), (y, s)) f(y, s)dyds, 

LBj{x,t) = / Bj ((x,t) ■ (y,s) -1 )-0((:r,t),(y,s))/(y,s)dyds. 



We shall deduce Theorem 11.11 and Theorem 1 1 . 21 from the following propositions. 



Proposition 2.2. 

(1) If a 2 > Cp, then 

(2) If a 2 = Cp, then 

Proposition 2.3. 

(1) If0<j3< 1, then, 

(i) For a 2 <C 0! 

(ii) For a 2 = Cp, 

(iii) For a 2 > Cp, 

(2) Ifl<P< 2, then 

(3) If2<0, then 



\\L Aj h^<^ a - in+ ^\ VjGN. 



\L Bj \\L^L' <2^ n +i^ VjeN. 
lifljII^L" <2^ Q -("+i)« VjeN. 



We get the first main result of this paper assuming these propositions: 

Proof of Theorem \1.1\ and Theorem \1.2\ From the reductions (|2.5|l , (|2.7j) and (|2.9p , in order to 
prove Theorem 1 1.1 1 it is enough to prove that \\Tj ||l 2 ->l 2 ^ 2 3< 2 for the operators Tj given in (|2.10p . 

From (|2.4[) and (|2 . 11 1) we have 7j = 2^L Aj with a suitable function p, and so 1 1 1 1 ^x, 2 = 

2^\\L Aj \\^2^ >L 2 . Therefore, the estimates of Proposition l2~2l yield Theorem ll.il In the same way, 
Proposition 12.31 establishes Theorem 11.21 □ 
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Proof of Theorem \1.3\ and Theorem \1.4\ By the duality argument, it is enough to prove for p < 2. 
We shall prove only the case (1) of Theorcm ll.3[ the other cases will follow from the same argument. 
Suppose p < 2 and a 2 > Cp. Since ||Tj|| L 2^ L 2 < \\Laj \\l 2 ^l 2 , Proposition 12.21 deduces the 
following. 

||T j || L3 _> £3 <2K a -< n +*>« 
and trivial young's inequality deduces 

\\Tjh^ < 2 J ' (a) - 

By interpolation we obtain 

\\Tj\\ L p^ L v < 2 3{a2{ p~^ )+[a ~ (n+ ^ )l3)2(1 ~p )) = 2 3(a ~ 2{n+ ^ ){1 ~p )) . 
We can sum the geometric series if a — 2(n+ |)(1 — i). This completes the proof. □ 

In the next section, we shall briefly review on the theory related to the operators La, and Lb } . 
We will make use of geometric properties of the phase function p(x,t)@ to prove Proposition 12.21 
and Proposition 12.31 

3. L 2 ESTIMATES 

We begin with the L 2 — > L 2 theory for oscillatory integral operators. The operators we are 
concern with are of the form 

Ttf{x) = j n e^y~>a(x,y)f(y)dy, 

where <j> G C°°(K" x E") and a G C£°(E" x E"). Suppose that the phase function <p satisfies 
det ^ gf Q y ^ 7^ on the support of a, we say that (j> is non-degenerate. We say that is degenerate 

if there is some point (xo, yo) where det ( q^.q v ^ 
we have the fundamental theorem of Hormander 



equals to zero. For non-degenerate phases, 



Theorem 3.1 (Hormander [9]). Suppose that the phase function </> is non-degenerate. Then we 
have 

WTth^L? < A"* VAe[l,oo). 

This theorem gives sharp decaying rate of the norm ||T^'||^2_ >i 2 in terms of A. However, the 
phase functions of our operators La 6 and can become degenerate according to the values of a 
and {3 (see Lemma 13.41 and Lemma I3.5[) . For a degenerate phase function </>, the optimal number 

for which the inequality ||Tx|| i 2_ i . i 2 < A _K * holds would be less than ^. The number k^'s are 
related to the type of fold of the phase <j> (see Definition I3.2f) . For phases whose types of folds are 
< 3, the sharp numbers were obtained by Greenleaf-Seeger [6] and Pan-Sogge [15]. We shall 
use the results. The sharp results for folding types < 3 in [6] are the best known results and there 
are no optimal results for folding types > 3 except some special cases established by Cuccagna [2] . 

It is well-known that the decaying property is strongly related to the geometry of the canonical 
relation, 

(3.1) C lj> = {(x,d x ct>{x,y),y,-d v <t>{x,y)) ; x,y € E"} c T*(E") x T*(M' y l ). 
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Definition 3.2. Let M\ and M2 be smooth manifolds of dimension n, and let / : Mi —> Mi be 
a smooth map of corank < 1. Let S = {P £ Mi : rank(Z?/) < n at P} be the singular set of /. 
Then we say that / has a A:— type fold at a point Pq £ S if 

(1) rank(£>/)| Po =n-l, 

(2) det(Z)/) vanishes of k order in the null direction at Pq. 

Here, the null direction is the unique direction vector v such that {D v f)\p = 0. 

Now we consider the two projection maps 



(3.2) tt l : C* ->T*(R£) and tt r : C$ -> r*(R£). 

Proposition 3.3 ([5].|15]). Suppose that the projection maps ttl aridity have 1 -type folds (Whitney 
folds) singularities, then 

||Ta/IU'(r») < ||/|| £a( R») VA g [1, co). 



// i/ie projection maps 7tl and 7r# /icrae 2-type folds singularities, then 

||7a/|U=(k») < A~^M H/IU^Rn) VA e [1, CO). 

In order to use Proposition ^. 3[ we shall study the projection maps (|3.2p associated to the phase 
function of the operators L J \ j and Ls r Recall that p(x,t) = (\x\ 4 + t 2 ) 1 / 4 and the phase function 
(f> of the integral operators La. and Lp j is 

(f>(x, t, y, s) = ((x, t) ■ (y, s)- 1 ) . 

To write the group law explicitly, we write x = (x 1 ,x 2 } and y — (y 1 ,?/ 2 ) with x° ,y 3 € R n . Set 
= p{x,t)-P. Then 

(3.3) 4>{x, t, y, s) = $ (x 1 ~y\x 2 - y 2 ,t - s - 2a{x 1 y 2 - x 2 y 1 )) . 

For notational purpose set t = Xi n +i and s = ym+\- To determine whether the phase function $ 
is non-degenerate, we need to calculate the determinant of the matrix, 



H = 



d 2 4>{x,t,y,s) 
dyidxj 



The determinant is calculated in Laghi [lOj . However we give a somewhat simpler computation by 
considering the matrix L associated naturally with the matrix H (see below), which will also be 
useful in Lemma T3. 61 and the proof of Proposition ^. 21 and Proposition ^. 31 

For simplicity, we write (x, t) = (x,t) ■ (y, s) _1 . By the Chain Rule, for 1 < i,j < n, we have 

d 

(3.4) dx~^ X ' *' V ' = ^ + 2a y«+J 9 2n+l] *(X, t), 

d 

' x, t, y, s) = [d j+n - 2ay J d 2n +i] $(x, t). 
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Using the Chain Rule once more, we get 
(3.5) 



d d 
dy l dxj 
d d 
dy n+i dxj 

_d d_ 

dyi n + j 
d d 



dy n+t dx n+j 
Define 



Then we have 



x,t,y,s) = [(ft + 2ax n+ td2n+i)(dj + 2ay n+ jd 2n +i)} <&(x,t), 
x,t,y,s) = [(d n+i - 2ax l d 2n+1 ){d j + 2ay n+j d 2n+1 )} $(x,t) + [2a%d 2n +i] *( x ,t), 
-4>{x,t,y,s) = [(ft + 2ax n+i d 2n+ i){d n+J - 2ay J d 2n +i)] $(x,t) - [2a5 lj d 2n +i] $(x,t), 
x,t,y,s) = [(d n+i ~2ax l d 2n +i)(d n+J ~ 2ay ] d 2n+ i)]^{x.,t). 



Mv) 



I 2aJy y 
.0 1 , 



J 



In 
-In 



H(x,t,y,s) =A a {x) (did,®) (x,t) A a (yf + 2a(ft„+i$)(x, t) 



(3.6) 



J 0' 
0, 



~-A a (x) 



{did,®) + 2a(9 2li+1 $) 



J 0' 
0, 



where the second equality holds because A a (x) 



J 




J 




(x,t) A a (yf, 
Set 



(3.7) 



L(x,t,y,s) 



(ftft$) + 2a(d 2n+1 $) 



J 1 
0, 



(x,t). 



Thus, to study the matrix H, it is enough to analyze the matrix L. Moreover we have dct(A a (x)) = 
det(A a (y)) = 1 and it implies that det(H(x,t,y, s)) = det(L(x, t, y, s)). Therefore it is enough to 
calculate the determinant of L. 

To find (|3.7[) we calculate the Hessian matrix of <£>. For 1 < i,j < 2n, 

f 



(3.8) 



ftd>(x,t) = -^(|x| 4 + t 2 )-^ 1 (4x,|x| 2 ), 



a 2n+1 $(x,t)--^(|x| 4 + t 2 )- i 



and 



(3.9) ftft$(x, t) = /3(|x| 4 + t 2 )-^" 2 [08 + 4)|x| 4 - 2(|x| 4 + t 2 )] x iXj - /3(|x| 4 + t 2 )"«-% |x| 
(3S|^ B+ i$(x,t) = P(0 + 4)(|x| 4 + t 2 )-T- 2 |x| 2 x, • ^ 

9 2 „ +1 $(x, t) = /?(/? + 4)(|x| 4 + t 2 )-^ ■ 1 - /?(|x| 4 + t 2 )-^ 1 ^. 
Set Z? = (|x| 2 x,|) T . Then the above computations show that 



(didj$) + 2a(d 2n+1 <I>) 



J 1 
0, 



(x,t) 



(3.11) 



=P{p + 4)(|x| 4 + t 2 )-^ 2 Z? • D T - £(|x| 4 + t 2 )-* 



i l /|x| 2 / + atJ + 2x-x T 

I ° i 



/3(|x| 4 + t 2 )-*- 1 (i? + i?), 
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where we set 

(3.12) B=|x| 2 / + atJ, A' = x-x T , E=( B + 2K f\ and R=-Si±%D-D T . 
V H ' ' V 5/ |x| 4 + t 2 

Then, from (pTTJ) and (j3~PTj) we get 

(3.13) L(x,t,y,s) = [-/3(|x| 4 +t 2 )-T-i( S + jR )] ( Xjt ). 
Lemma 3.4. JFe /iai/e 

det J ff(a-,t, 2 /, S ) = J F 1 ((x,i)-(y,s)- 1 ), 

where F(x,t) = C a ^(\x\ 4 + a 2 t 2 ) mi (|x| 4 + t 2 ) ni2 f(x, t) for some m 1 ,m 2 ,c a ^ £ K and f(x,t) = 
2((3 + l)\x\ s + (308 + 2) - 2a 2 )|x| 4 t 2 + (/3 + 2)a 2 f 4 . 

Proof. We write (x, t) = (x, f) • (y,s) _1 again. In view of (|3.6j) . (|3.7[) and (|3.13[) . it is enough to 
show that 

dct[-/?(|x| 4 + t 2 )-^-!^ + i?)] = F (x, t). 

Considering the form of the function F given, we only need to compute det(-E + R). From (|3.12l) 
we have 



E + R= B + 2K °)-M±%D.D- 



\) |xj 4 + t 2 " 

For notational convenience, we shall use lower-case letters f\ , . . . , f m to denote the rows of a given 
m x m matrix F. Notice that DD T is of rank 1 and we have the following equality 

m 

(3.14) det(P + Q) = det(P) + ^dct(pf , . . . ,pj_ v qj ,pj +1 , . . . 

i=i 

for any m x m matrices P and Q with rank Q = 1. Recall that S = x| 2 / + at J and if = x • x T , 
then direct calculations show that 

(3.15) det(B) = (|x| 4 + a 2 t 2 )™ 

and 
(3.16) 



j I ii 

x, det (&f , • • • , fcj, 6J +1 , • ■ ■ , fei;) + X! x i+« dct • • • , bj +n _ l7 kj +n , b) 



b T ■■■ b T 

3=1 ' 3=1 



= ^x J (|x| 2 x,+x, 1+ ,at)(|x| 4 + a 2 t 2 )"- 1 +^x, + „(|x| 2 x J+n -x ja t)(|x| 4 + a 2 t 2 )"- 1 

3=1 3 = 1 

^(Ix^ + a 2 ! 2 )"- 1 ^! 4 . 

Thus, from ([314) . (|3"T5)) and (j3~T5)) . we get 

det(B + 2K) =(|x| 4 + a 2 t 2 )" + 2|x| 4 (|x| 4 + ah 2 ) 11 ' 1 
(3 ' 17) =(|x| 4 +a 2 t 2 )"- 1 (3|x| 4 + a 2 t 2 ). 
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Using p.l4|) once again, we obtain 



2;; 



(3.18) 



det(E + R) = det(E) + - ^ det 



/ ei \ 
\ e 2n J 



det 



/ ei \ 



e2n 
V»"2n+l/ 



Si + S 2 + S3. 



From p,17p we have 



. B + 2K 0\ 1 
Si = det , = - 

V \) 



Using rank K = 1 we get 



det 



ei \ 




/ bi + 2h \ 


ej-i 




bj-i + 2kj-i 




= det 


-(/3+4)|x| 4 , 
|x| 4 +t 2 J 


e j+ i 




b j+ i + 2k j+ i 


e 2n J 




\ b 2n + 2k 2n J 



det(B + 2K) = -(|x| 4 + a 2 t 2 ) n " 1 (3|x| 4 + a 2 t 2 ). 



( bi \ 



(/3 + 4)|x|- 
Ix| 4 + t 2 



det 



b j+ i 
\b 2n J 



Therefore, 

Finally, 
(3.19) 



1 /(/? + 4)|x| 4 



Sa = det 



B + 2K 

V * 

(3 + 4: t 2 

x\ 4 + t 2 4 ( 



14 _i_ +2 



/3+4 t 2 
|x| 4 +t 2 4 



Ixfflxf + oV)*- 1 . 



/3 + 4 t 2 



14 ,+2 



t 2 4 



dctfB + 2iH 



|x| 4 + a 2 t 2 )' l - 1 (3|x| 4 + a 2 t 2 ). 



Adding all these terms together, we get 

det(E + R)= p(|x| 4 + a 2 t 2 ) g(|x| 4 + t 2 ) /(x, t), 
where p(r) = c p r mi , q(r) = r™ 12 for some TOi,m 2 ,c p G R and 

/(x, t) = 208 + l)|x| 8 + (3(/3 + 2) - 2a 2 )|x| 4 t 2 + ((3 + 2)a 2 t 4 . 
The proof is complete. 



□ 



Now, we should determine when the determinant of H(x 1 t,y 1 s) can be zero for some values 
(x, t, y, s) with p ((x, t) ■ (y, s)^ 1 ) ~ 1. Furthermore, to determine the type of folds in the degener- 
ate cases, it is crucial to know the shape of the factorization. 

Lemma 3.5. There are nonzero constants 7, c, ci, 02,03 with c\ 7^ c 2 and C3 > that are deter- 
mined by (3 and a such that: 
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• Case 1: 

• 7/0G (-1,0) U (0,oo) and a 2 <Cp, then f(x,t) > 0. 

■ If (3 G (-1,0) U (0,oo) and a 2 = Cp, then f(x,t) = 7 (|a;| 2 - ci 2 ) 2 . 

■ // G (-1,0) U (0,oo) and a 2 > Qj, taen /(a,*) = 7(|x| 2 - Cl £)(|a;| 2 + cit)(|a;| 2 - 
c 2 t)(\x\ 2 +c 2 t). 

• Case 2: 

• 7/0 G (-2,-1), f/ l en/(.T,t) = 7 (| a; | 2 -c 1 i)(|x| 2 + c 1 i)(|x| 4 + c 3 i 2 ). 

• Case 3: 

• 1/0 e (oo, -2), i/ien /(as, t) < 0. 

Proof. Let g(y, s) = 2(0 + l)y 2 + (3(0 + 2) - 2a 2 )j/s + (0 + 2)a 2 s 2 . Then /(x,i) = g{\x\ 4 ,t 2 ). 
Suppose G (-1, 0) U (0, oo). First, we see that f(x, t) > for 3(0 + 2) - 2a 2 > 0. Secondly, we 
have f(x,t) > if 

A := 4a 4 - 4(0 + 2) (2/3 + 5)a 2 + 9(0 + 2) 2 < 0. 

This holds if and only if 

Cp <a 2 < C+, 

where 

C± = ^(2/3 + 5± v / (2/5 + 5) 2 -9). 

Observe that 

(3.20)C a - = + 5 " 7(2/3 + 5)" - 9) = ^-±-2(2/3 + 5 - vW+W+«i 

(^)(2 /3 + 5- v WW) = ^. 

We can combine the above two conditions as g(y,s) > for a 2 < C^. For a 2 = C^, we have 
g(y,s) = j(y — cs) 2 for some c > 0. For a 2 > Cp, we have g{y, s) = j(y — c\s)(y — C2s) for some 
ci,c 2 > since 2(0+1) ■ (0 + 2)a 2 > 0. 

Finally, if j3 G (-2, -1), then 2(f3 + l)(f3 + 2)a 2 < 0, and so g(y,s) = j(y - as)(y + c 2 s). If 
(3 G (-oo, -2), then 2(0 + 1) < 0, 3(0 + 2) - 2a 2 < and + 2 < 0. Thus s) < 0. This 
completes the proof. □ 

Lemma 3.6. Let L\{x 1 1, y, s) be the upper left (2n) x (2n) block matrix of L(x, t, y, s) and suppose 
that (x,t,y,s) is contained in S. If ^ —4, then 

det Li(x, t, y, s) ^ 0. 

Proof. For simplicity, set (z, w) := (x, t) ■ (y, s) _1 . In view of (|3.12[) and (|3.13[) . except the nonzero 
common facts, we only need to check that the determinant of 

M(z, w) = (\z\ 2 I + aw J + 2z ■ z T - (0 + A)j I j^x ■ z T ) , 

is nonzero for (z, w) ^ (0, 0). This determinant can be calculated in the same way as the determi- 
nant of L by using (j3~T5j) and (j3~T7j) . We find 

H 4 

14 i „„2 



< 



det(M(z, w)) =(\z\ 4 + a 2 w 2 ) n + (|z| 4 + a 2 w 2 ) n - i \z\' 1 2 - (0 + 4) 



(3 ' 21) _ (|z| 4 + a 2 W 2 )"- 1 

|z| 4 + w 2 



z^ + W 

-08 + 1)M 8 + {a 2 + 3)|z| V + a 2 w i ] 
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Notice that (z,w) is in S and satisfies 

(3.22) 2(0 + l)|z| 8 + (308 + 2) - 2a 2 )\z\ 4 w 2 + (0 + 2)a 2 w 4 = 0. 

From (f3~2T|) and (j3~22|) we get 

det(M(z,w)) = (|z| |t 4 aW r 1 ^(/ 3 + 4 ) [M' + ^w 2 ] . 
|z| 4 + w z 2 

If w = 0, then z becomes zero in (|3.22[) . Because (z,w) ^ (0,0), w should be nonzero. Thus 
det(M(z,w)) 7^ 0. The Lemma is proved. □ 

We are now ready to prove our first main theorems by studying the canonical relation (|3.1| 
associated to the phase $, 

= {((x,t),$ (Xtt) ,(y,s),-$ (ytS) )} C T*(R 2n+1 ) x T*(K 2n+1 ), 

and the associated projection maps n L : C$ -> T*(R 2n+1 ) and ir R : C$ -> T*(R 2n+1 ). 

Proof of Proposition Proposition \2.3[ Let 

S = {(x, t, y, s) : det H(x, t, y, s) = 0}. 

In view of Proposition 13.31 it is enough to show that on the hypcrsurface S, 

(1) If j3 £ (—2, —1) or f3 £ (—1,0) U (0,oo) and a 2 > Cp, then both projections and 7Tr 
have 1-type folds singularities. 

(2) If f3 £ ( — 1, 0) U (0, oo ) and a 2 = Cp, then both ttl and 7Tij have 2-type folds singularities. 

We will only prove (1). The second case can be proved in the same way, the only difference is the 
form of factorizations in Lemma 13.51 which determine the order of types. We need to show that on 
the hypcrsurface 5, both ttl and ttr have 1-type folds singularities. Rcall from Lemma I3T41 that 5 
is a subset of R 2n+1 consisting of (x, t, y, s) £ R 2 ( 2n+1 ) such that 

F((x,t) ■ (y,s) _1 ) = F (x - y,s - t + 2ax T Jy) = and p ((x, t) ■ (y, s)" 1 ) ~ 1. 

From the form of F and the fact that ((x, t) ■ (y, s) _1 ) ^ 0, we have 

S = {(x, t, y, s) £ R 2 ( 2n+1 ) \f[x-y,8-t+ 2ax T Jy) = 0, p ({x, t) ■ (y, s)" 1 ) ~ 1}. 

From Theorem 13.51 we have 

f{x, t) = 7 (|z| 2 - Cl t){\x\ 2 + Cl t){\x\ 2 - c 2 t){\x\ 2 + cat). 

for some two different constants c%, c 2 > 0. 

Note that Lemma [3.61 implies the condition (1) of Definition 13.21 is satisfied. Therefore, it is 
enough to show the second condition, i.e., at each point Pq £ S the determinant of Df vanishes with 
order 1 in each null direction of dmi, and dix^ at Pq. Fix a point Pq = (x,t,y,s) £ R 2n+1 x M. 2n+1 
and assume that Pq is contained in 

Si =: {(x,t,y,s) e R 2 ( 2n+1 ) | \ x - y\ 2 - ci(s - t + 2ax T Jy) =0}. 

We may identify C$ = {((x,t), $( x , t ), (y, s), -®( y , s ))} with an open set in R( 2 "+ 1 ) x IR( 2 "+ 1 ) by 
the diffeomorphsim V : R< 2n+1 ) x R( 2 ™+ 1 ) -> S given by 

ip(x,t,y,s) = ({x,t),^ (Xjt) ,(y,s),-^ { y. s - ) ) . 
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Let vl £ M 2 ( 2n+1 ) be a null direction of cLttl at Po, i.e., 

(J \ 

a 2 * a 2 * 



vl=0. 



\<9(x,t)<9(x,t) a (y,s) a (x,t) / 

Thus, vl is of the form vl = (0, 0, z, w) with w € K 2 ™ and s € K such that 

<9 2 $ /. ~ 



(3.23) 



= 0. 



To check that dct H(x, t, y, s) vanishes of order 1 in the direction vl, it is enough to show that Vl 
is not orthogonal to the gradient vector v g of det H(x, t, y, s) at P . By a direct calculation we see 
that the gradient vector v g is equal to 

D( x , t ),(y, s )^ ((x,t) ■ {y,sy 1 )\ p = (2(x -y) -2ac 1 aJy, -ci, -2(x - y) - 2ac x x T J, a) 

Suppose with a view to contradiction that vl and v g are orthogonal. It means that 

(3.24) -2{x-y)-z- 2ac\x T J ■ z + c lW = 0. 



From (13.61). we have 



(3.25) 



<9 2 $ 



A a {y) 



A simple calculation shows that 



(didj$) - 2a(d 2n+1 $) 



J 0' 

0, 



(x,t) A a (xf 



w 



w 



( 1 




\2ax n+1 






1 



-2ax\ 



0\ 



: 

1 
-2ax n 1/ 



Z 2 



Z2n 

W 



z 2n , 2a(x n+ izi H h x 2n z n - x x z n+1 

On the other hand, from the orthogonal assumption p.24[) we get 

2(x -y)-z 



x n z 2n ) + w) 



2a(x n+1 zi H x n z 2n ) + iv 



Thus, 



A a {xf 



w 



Z\, z 2 , 



Z2,. 



Cl 



2{x~y)-z 
ci 



Recall that 



(didj$) - 2a(9 2 „+i$) 



J 0' 
0, 



(x,t) = G8 + 4) 



/ |x| 4 x 2 



V|X| 2 |X! 



| X I <Z/ 2. fi I I 1 o ^ 



|^| ~2^n 



2^. t 



N 4 + t 2 ) 
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Substituting x — y for x and t — s + 2ax Jy = 



_ \x-y\ 



for t, where the equality holds since the point 



Pq is on the surface Si. Then, from (2n + l)-th equality in (|3.23[) with p.25|) . we have 



[fi + A) 



1 \x-y\ 



2 C/3S 

Rearranging it, we obtain 



(x-y)-z + 



-{x-y)-z 



2c 



PA 



PA 



C PA 



v\ A (x - y) ■ z = 0. 



PA 



-) — {x-y) 

C PA 



Thus [x — y) ■ z = 0, and hence 
A a (x) T 



(zi,Z 2 ,--- ,Z2n,0) and Li(x,t,y,s) ■ ([[zi,Z2,--- ,22n)) 



= 0. 



Now from det L\ ^ in Lemma we have z = and sow = from (|3.24[) . This is a contradiction 
since vl should be a nonzero direction vector. Therefore Vl and vr can not be orthogonal. 

Now we shall prove the same conclusion for (Ikr without repeating the calculations. Note that 
the above argument for cIttl is exactly to show that there is no nontrivial solution (z, w) of the 
system of equation S(a, x, y): 

A a {y) (d i d j $)-2a(d 2n+ i$) ' 





A a {x) T ■ 



0. 



and 



(— 2(x -y)- 2acj3,ix T J, cp t i) ■ (z, w) = 0. 



On the other hand, to show the folding type condition for the projection ttr, it is enough to show 
that there is no nontrivial solution vr = (zo,u>o,0,0) which satisfies the system of equations : 



i:) 2 



dyidx 



-<t>) 



wo, 



A a (x) 



(flSifit,-*) + 2a(9 2n+1 $ 




A a {y? 



w 0/ 



0. 



and 



(2(x -y) + 2ac/3 i iy T J, -cp t i) ■ (z , w ) = 0. 



Because A_ a (— x) = A a (x) and A_ a (— y) = A a (y), the above system can be written as follows. 



k dyidx 



A- a (-x) 



(d i d j $)-2{-a)(d an +i*) 




and 



A- a {-yf 



0. 



wo, 



0, 



(~ 2 ((-y) - (-2-')) - 2 (-a) c /3,i(-2/) T ^ c/j.i) • (z ,w ) 

We now see that (zo, wq) satisfies the system S(—a, —y, —x). Since the above argument for proving 
nonexistence of nontrivial solution of S(a, x, y) does not depend on specific values of a, x and y, 
the same conclusion holds for the system S(—a, —y, —x). This completes the proof. □ 

Remark 3.7. On R", the oscillating kernel is of the form \x\~ 7 e 1 ^ with j3 ^ 0. The behavior 
for the phases \x\° depends only on whether /3 ^ 1 or /3 = 1. Precisely, for /3 ^ 1, we have 
det 



for any (x, y) with x ^ 



(dS^ ~ y\ P ) ^ for an y <>>2/) with x ^= y, but det (gg^|x - y| 
y and this case correspond to Bochner-Ricsz means operators, which still remains as a conjecture. 
On hand, the phase p((x,t) ■ (y, s)^ 1 )^ has fold of the highest order type when /3 = 1 or ft = 2, 



0. 
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which also remains open in this paper. In order to establish the sharp L 2 estimate for these cases, 
we would need to improve the current theory of oscillatory integral estimates for degenerate phases 
to higher orders (see [HEl E])- 

Remark 3.8. We note that from Lemma \3. 61 and Case 3 of Lemma I3~5l 
(3.27) \\L Aj \\ L i_> L 2 + \\L Bj \\ L ^ L 2 < 2^-"^ 

holds for all cases. It will be sufficient to use this weaker bound for the Hardy spaces estimates in 
Section 5. 



4. Hardy spaces on the Heisenberg groups 

In this section we recall some properties of Hardy spaces on the Heisenberg group. We refer 
Coifman- Weiss [T] and Folland-Stein [5] for the details. From now on, we shall write p{x) (resp., 
x ■ y) just as \x\ (resp., xy) for notational convenience. It is known that \x ■ y\ < \x\ + \y\ holds for 
all x,y £ H™ (see Ql p. 688]). 

The left-invariant vector fields on H™ is spanned by T — and Xj = g|- + 2ax n+ j , Xj +n = 
-Q^r-^ 2ax n -^, 1 < j < n. Let Yj = Xj for 1 < j < 2n and Y 2n +i = T. We say that the right- 
invariant differential operator Y 1 = Y^ 1 ■ ■ ■ Y^Vj 1 has homogeneous degree d(I) = i\ + i 2 + ■ ■ ■ + 
i2n + 2i-2n+i- For a £ N, we define V a to be the set of all homogeneous polynomials of degree a. 

Suppose that x G H™, a £ N, and / is a function whose distributional derivatives Y 1 f are 
continuous in a neighborhood of x for d(I) < a. The homogeneous right Taylor polynomial of / 
at x of degree a is the unique Pf :X £ Va such that F 7 P/ jX (0) = Y 1 f(x) for d(I) < a. 

Proposition 4.1 (j5]). Suppose that f £ C k+1 , T £ S 1 , and Pf yX (y) = J2d(i)<k a i( x ) r l I (y) * s ^ e 
right Taylor polynomial of f at x of homogeneous degree k. Then a/ is a linear combination of the 
Y J f for d(J) < k, 

(4.1) \f(yx)-Pf. x (y)\<C k \y\ k+1 sup |F 7 /(^)|. 

d(7)=fc+l 
\z\<b k+1 \y\ 

We will use some properties for H p functions including the atomic decomposition and the 
molecular characterization. For 0<p<l<q<oo,p^q,s£7i and s > [(2n + 2)(l/p — 1)], we 
say that the triple (p, q, s) is admissible. 

Definition 4.2. For an admissible triple (p,q,s), we define (p, q, s)-atom centered at xq as a 
function a £ L q (M n ) supported on a ball B C H" with center xo in such way that 

(i) Hi, < \b\v«-vp. 

(ii) / H „ a(x)P(x)dx = for all P £ V s . 

Later, we will choose q — 2 to use the L 2 boundedness (J3T2TJ) obtained in Section 3. 

Proposition 4.3 (Atomic decomposition in W; see [T]). Let (p, q, s) be an admissible triple. Then 
any f in H p can be represented as a linear combination of (p, q, s)- atoms, 

oo 

f = J2^ifi, A t eC, 
t=i 

where the fi are (p, q, s)-atoms and the sum converges in H p . Moreover, ||/||^ P ~ i n f{Si^i l^i| P ■ 
^2\fi is a decomposition of f into (p,q,s)-atoms\. 
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For an admissible triple (p, q, s), we choose an arbitrary real number e > max{s/ (2?i+2), 1/p— 1}. 
Then we call (p, q, s, e) an admissible quadruple. Now we introduce the molecules. 

Definition 4.4. Let (p, q, s, e) be an admissible quadruple. We set 
(4.2) a=l-l/p + e, b=l-l/q + e. 

A (p, q, s, e)-molecule centered at xq is a function M € L q (M n ) such that 

(1) M(x) ■ \ X q 1 x\^ n+2 ^ b 6 L q (W n ). 

(2) \\M\\ a q /b • ||Af(a?) • \xQ 1 x\ ( - 2n+2 ^ b \\ 1 q ~ a ^ b =M{M) < oo. 

(3) J H „ M{x)P(x)dx = for every P e V s . 

Theorem 4.5. 

(1) Every (p, q, s')-atom f is a (p, g, s, e) -molecule for any e > max{s/ (2n + 2), 1/p — 1}, s < s' 
and J\f(f) < C\, where the constant C\ is independent of the atom. 

(2) Every (jp, q, s, e)-molecule M is in H p and \\M\\hp < C^A/^A/), where the constant C% is 
independent of the molecule. 

Thanks to this Theorem, in order to verify that T is bounded on H p it is enough to show that, 
for allp-atoms /, the function Tf is ap-molecule and N(Tf) < C for some constant C independent 
of/. 

5. H p ESTIMATES 

Wc start with a lemma which will be useful in the proofs of the sequel. 

Lemma 5.1. 

(1) Suppose that d < 0, c + d < and B > 1. Then 

oo 

^2 CJ min{l,P2'*} < 1 + (log P)P~z. 

i=i 

(2) Suppose that c < ; d > and B < 1. Then 

oo 

^2 CJ min{l,P2*} < P + | logP|P~3. 

3=1 

Proof. Set X = 2 C J min{l, P2*'}. Then, 

K= 2 (c+d)j + ^ 2 CJ . 

B2*'<1 B2*>1 

A straighforward calculation gives the bound for if. Suppose that d<0, c + o!>0 and P > 1. 
Then 

- K < 1 for c < 0, 

- AT < log P for c = 0, 

- A < p-i for c> 0. 

In any case we see that A < 1 + (log P)P~§ . Suppose now that c < 0, d > and P < 1. Then 

- A < P for c + d < 0, 

- A<logP-P forc + d = 0, 

- A < P-i for c + d > 0. 
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In any case we have K < B + | log B\B~% . The Lemma is proved. □ 
Theorem 5.2. Assume p < 1 and (~ — l)(2?i + 2)/3 + a < 0. T/ien Tk„ p is bounded on H p . 
Proof. From the decompostion of kernel (|2.1|) , we have 

ii#«,wiik<£ii<Wiiv 

We shall bound the norm a * for each j 6 N by some constant multiple of 

Notice that Kj(x,t) — p(x, £)-( 2 ™+ 2 + Q ) e i P( :E ,t) x(2ip(x, t)). From the atomic decomposition for 
H p space, it is enough to establish the estimate for any atom / supported on B(0,R) with some 
R > such that 

- \\fh*<R [ 



? (2n+2)(i-i) 



(5.1) 



f(x)x a dx = 0, for all Id < s = f(2n + 2)(- - 1)1. 

P 



In view of part (2) of Theorem 14.51 it suffices to bound Af(Kj * /). For an admissible quadruple, 
we choose an e > max{ 2n s +2 , - — 1} = - — 1 and set e = - — 1 + 8 with some 5 > 0. Then 



we have a = 6 and b 



i + S in 



We will choose S sufficiently small later. Recall that 



Af{Kj * /) = \\Kj * f\\ a 2 /b • \\Kj * f(x) ■ \x\^ 2n+2 ^ b \\\ a/b . From the L 2 estimate (1X271) we get 



(5.2) 
We have 

where 
h 
Then 

(5.3) 



ll^*/l|2<2^ (Q -"«| 



2- 



IIX, ^) ■ M (2 " +2) l2 = / \K J *f(x)\ 2 -\x\ 2 ^ b dx = I 1 +I 2 , 
/ \K * f(x)\ 2 ■ \ x \ 2 ^+ 2 ) b dx and I 2 = [ \K, * f(x)\ 2 ■ \ x \ 2 ( 2 "+ 2 ) b dx. 



\x\>2R 



Eii^*/ii^<E^*/)* 

3>1 j>l 



a/b (T l/2(l-a/b) 
2 ' V 1 ! 



I. 



l/2(l-a/b) 



J>1 



|pa/b _ jp/2(l-a/b) 



■Eii^*/ii2 - J i 



pa/b r p/2(l-a/6) 
2 



Set 5i - E 7 >i \\Kj * f 



pa/b jp/2(l-a/b) 



and S 2 = E 7 >i 11^ * • ^ 



pa/b r p/2(l-a/6) 



Then it is 



enough to show that Si < 1 and S2 < 1. We use (|3.27|) and (|5.1j) to bound 1\ as follows. 



A < / 1/ * K 3 (x)\ 2 dx ■ R 2 ^+ 2 ) b < 2 2 ^ a - n ^\\f\\ 2 ■ R 2 ( 2 "+ 2 ) b 

(5.4) < 2 2i(a-r l/ 3)^2(2r l +2)b _ R (2n+2)(l-2/p) 
< 2 2i(a-(n+l/2)/3)^2(2n+2) ^ 

where the last inequality comes from (|5 . 1[) . From (|5.2p and (|5.4p we have 

(5.5) |[A"j * /||2 /b • / 1 1/2(1_a/b) < j2-?'( a -"' 3 )i?( 2 «+ 2 H 1 /2-i/p) j a/b . |2J( Q -«^) . ^(2«+2) | 

_ 2i(a-"/3) 



(1-a/b) 
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where the equality comes from the calculation (a - p)f + a (l — f ) = f(2 — p~ a )+ a = f( — b)+a = 0. 
Thus we have Si < ^>i 2^"-™^ < 1. 

Now we consider I2 and S2. We have = for R > 1 since the support of Kj * f is contained 
in the subset {x : \x\ < 1 + R} which is a subset of {x : |x| < 2R} for R > 1. Thus we may only 
consider the case R < 1. In the following integral expression 

{K j *f){x)= I K 3 (xy~ 1 )f(y)dy, 



We have : | < 2 J and |y < R. These imply \x\ < \xy 1 + \y\ < 2 3 + P. It means that 
^2 = for 2~-' < R. Thus we only need to consider j e N such that > R, for which we have 
\x\ < 2-3+ 1 for x e Supp(A' i * /). Then we get 

(5.6) h= ( \f*K 3 {x)\ 2 -\x\ 2l < 2n+ V b dx< f \f * K 3 (x)\ 2 dx ■ 2 -^ 2n + 2 ^ . 

J|x|>2_R J|an|>27?. 

From Proposition 0TTJ for any / G No, there is a polynomial P? of degree < / such that 
\K ] {xy- 1 )-P^y)\<\y\ I+1 sup \X a Ki{xy- r )\ 

(5.7) |a|<-T+l 

<|y| /+1 2 : '' (2 ™ +2+Q) 2 i(,3+1)(7+1) . 
From (|5.ip we get the identity for < / < s, 

Kj * /(*) = J (Kjixy- 1 ) - Pf{y))f{y)dy. 

Note that f{y) has support in \y\ < R, then from (|5.1[) and (|5.7[) we get 

(5.8) 1*0 */(*)! < i? / + 1 2^ 2 " +2+Q ' 2 ^' 3+1 )( 7 + 1 ' / 

J\y\<R 

(5.9) < ^/+l2J(2n+2+a)2i(/3+l)(/+l)^i(2r i +2)||j|| 2 

< 2 oi 2n + 2 + a ) ^2 3{l3+1) ) {1+1) R {2n+2){1 ~p ] . 

Now we can estimate (|5.6[) as 

(5.10) /9 < 2- 2 ( 2n + 2 ) b J2~ j(2 ™ +2) |2 i(2 " +2+ct) (^2^ (/3+1) ) (/+1) i? (2 " +2)(1_ p 'j 2 . 

= 2 2j{(2n+2)(l-i-a)+Q} ( - i?2J (/J+l))2(/+l) i? 2(2n+2)(l-i)_ 

Here we may choose / = or / = s, which gives 

I 2 < 2 2i{(2n+2)(l-i-5)+a} i? 2(2n+2)(l-i) min { 1; (£2^ +1 ) ) 2 < s+1 ) }. 

Now we have 

\\K- * f\\ a/b . i^ ( - 1 ~ a/b) < {2i( Q -™/ 3 )^( 2 ™+ 2 )( 1 /2-i/p)}Q/6 
(5.H) 3 ' 2 , 

_| 2 j{(2n+2)(l-i-5)+a} iJ (2r l +2)(l-A) min / ^ ( i?2 - 7 ' ( ' 3+1) ) ( - s+1 A jX 1 " /*) . 

Fromp < 1 and a < we have (2n + 2)(1 - ± - 5) + a < 0. Thus, if min(l, (P2 J '^ +1 )) S+1 ) = 1 the 
exponent of 2 J is smaller than zero provided a is small enough. Recall that R < 1. Then, using 
(2) in Lemma EH] we get 

W K i * ll2 Q/b • J 2 f ^ + I lo g^l ' i?PKa - 

j">i 
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where 

£»gs 1 W_ R (2n+2)(l/2-l/phpa/6 . r R (2n+2)(l-^)+(s+l)y(l-a/b)^ 



R -j^ l [a-{n+l/2)P] R (2n+2){l/2-l/p) 



pS/b 



R - 1 3T T i(2n+2)(l-l/p-S)+ a ] R (2n+2)(l-l/p) 



p(l-8/b) 



Observe that 



^o = {(2n + 2)(l--) + (s+l)}>0, 
P 

and 

Ko = --^—[(2n + 2)/3(- - 1) + a] > 0. 
p + 1 p 

Thus, for <5 small enough, we have /is, k$ > and since i? < 1, 

(5.13) ^ || Kj * f\\ p 2 a/b ■ /| (1 " a/b) < RP»° + | logi?| ■ RP K ° < 1. 

We then conclude that S% < 1. The proof is complete. □ 

We now consider Tl q . . Observe that the oscillating term e 1 ^^ exhibits different behavior 
whether 0</3<lor/3>l. Asp goes to infinity, the oscillation becomes faint if for the case 
< /3 < 1. In contrary, the oscillation grows to infinity for j3 > 1. Hence we deal with the two 
cases seperately. 

Theorem 5.3. Assume < /3 < 1 and p < 1 and (- — l)(2n + 2)/3 + a < 0. Then the operator 
Ti, a . is bounded on H p space. 

Proof. From (|2.2j) we have 

(5.14) II^WII^EKWIIff- 

We now estimate each norm 11^ « * / ||ffp by ||/||hp. From the atomic decomposition for H p space, 
we may choose / as an atom supported on i?(0, R) with some R > 0, which satisfies 

- 11/11^ <i? (2 " +2)( ^\ 

(5.15) , ! 

- f(x)x a dx = Q, for all a < s = (2n + 2)(- - 1) . 
J P 

From (b) in Thcorcm l4.5[ it suffices to estimate Af(Lj * /). For an admissible quadruple (p, q, s, e) 
we may choose any e > max{ 2 n+2 ' p ^ = p ^' Simply we let e = | — 1 + 5 with some 5 > 0. 
Then we have a = 5 and b = i — | + 5. for (|4.2j) . We will choose 5 sufficiently small later. 
From (|3~271) we have 

l|ii*/||2<2^-"«||/|| 2 . 

We have 

(5.16) \\Lj * f(x) ■ |xp"+ 2 > b || 2 = / \Lj * f(x)\ 2 ■ \x\^ 2n +^ b dx = I 1 + h, 



where 



h= f \L t * f(x)\ 2 ■ |x| 2 ( 2 "+ 2 ) & dx and I 2 = [ \L * f(x)\ 2 • |x| 2 ( 2 " +2 > b dx. 

J\x\<2R J\x\>2R 
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Then, 

J>1 J>1 
(5.17) <E * fWi /b • (A 1/2(1 -° /6) + 7 2 1/2(1 - a/b) )) P 

< E 11^' * ^iir 76 • ii /2(1 - a/h) + E ii^ * f\\ p 2 a/b ■ i p 2 /2(1 - a/h) 

Set Si = Ei>i \\L 3 *f\\l a/b -I[ /2{l ~ a/b) and S 2 = E,->i \\L, * f\f 2 a/b ■ I p 2 /2{1 ~ a/b) . Then it is enough 
to show that Si < 1 and S 2 < 1. First we estimate Ji with L 2 estimates (|3.27|) as follows 



(5.18) h< / \f*L J (x)\ 2 dx-R^ 2n+ ^ b <2 2 ^ a - n ^\\f\\ 2 2 -R^ 2n+ ^ b 

< 2 2i(a-n/9) p2(2n+2)6 , p(2ra+2)(l-2/p) _ 22j(a-(ra+l/2)/9) p2(2n+2),5 



Thus we can bound * /|| 2 /6 • a/b) 



(5.19]|Lj * /||2 /b • i 1 1/2(1 ~ a/b) < |2i( Q ""' 3 )^( 2 "+ 2 )( 1 /2-l/p)| a/b . | 2 i(«-n/9) . i? (2n+2)«5| (1 

_ 2i(a-"/3) 

and we have Si < Ej>i 2^ a ~ n ^ < 1. 

For I 2 we consider the two cases R > 1 and i? < 1. 
Case (i): Suppose R > 1. In the integral 

(£,• */)(*) = / L j (xy- 1 )f(y)dy, 

we have | iz; j/ 1 1 < 2 J and \y\ < R, which imply < + \y\ < 2 J + R. Therefore, in (|5.16|) . 

we have that I 2 — Q for 2 J < R. Thus we only need to consider j with 2 J > R. Then we have 
M < 2 J+1 for x in the support of Lj * f, and so 

(5.20) I 2 < f \f*L 3 {x)\ 2 dx-2 2{2n+2)b '. 

J\x\>2R 

By ([ill we have 

(5.21) l^ter 1 ) -WIS su p l^^^y- 1 )! 

a|</+l 

< \y\ I + 1 2~ j{2n + 2 - a h :iil3 - 1) ( I+1 ' ) . 

Since f(y) has support in \y\ < R and (|5.15|) . we have 

(5.22) \L *f{x)\<R I+1 2-^ 2n+2 -^2^- 1 ^ I+1 ^j \f(y)\dy 



J\y\<R 

(5.23) < R I+1 2~ 3{2n+2 ~ a) 2~ ]{l3 ~ 1){ - I+1) R^ 2n+2) \\f\\ 2 . 

< 2 -j(2n+2-Qi) , R2 -j(p-l)s(I+l) ^(2n+2)(l-i) _ 

Thus we can estimate (|5 . 20[) as 

(5.24) J 2 < 2 2 ( 2 ™+ 2 ) b -J'2 j(2 ™ +2) |2^'( 2n + 2 - Q )(i?2 _i( ' 3_1) ) (/+1) i? (2n+2)(1_ p ) | Z 

_ 2 2 j{(2n+2)(l/p+l+5)+Q ! } ^ R2 j(l3-r)^2(I+l) ^2(2n+2)(l- A) _ 
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Here we may choose 1 = and I = s, which gives 

l 2 < 2 2 J{( 2n + 2 )( 1 /p-i+<5)+"}^ 2 (2«+2)(i-i) min r 1; (^2- J '(' 3 " 1) ) 2(;s+1) }. 

Thus, 

\\L - * f\\ a/b ■ I? { ' 1 ~ alh) < {2 j(a ~ nl3) R {2n+2)( - 1/2 ~ 1/p) } a/h 
(5.25) J N 

.| 2 j{(2«+2)(l/p-l+5)+ Q } i? (2ri+2)(l-i) min / ^ ^^-^(H-lA |(l-a/6)_ 

Provided (5 is small enough, we have 

(24542@)(i -l + 6) + a+(/3- l)(a + 1) = (2n + 2)(- - 1 + £) + a + [fi - l)([(2n + 2)(- - 1)] + 1) 
P P P 

(5.27) < (2n + 2)(- - 1 + 8) + a + (/3 - l)(2n + 2)(- - 1) 

P P 

= (2n + 2)(- - I)j8 + a + (2n + 2)5 < 0. 
P 

Therefore the index of V in ([5~2"5]) with (i?2-? ( ' 3 - 1 )) s+:L is negative for small 5 > 0. Remind that 
i? > 1. Then, from (1) in Lemma I5TT1 we have 

X] \\Lj * f\\ p 2 a/b ■ /| (1 "° /6) < i? W5 + log(i2 + l)R pK \ 

where 

(5S8V = #( 2 «+ 2 H 1 / 2 -l/p)T i + ( 2 n+ 2 )(l-l/p)p(l-a/&) 5 

^p K5 _ j_ R - I i ? [a-n i 9]jj(2n+2)(l/2-l/p)]p«/6 . {(2n+2)(l/p-l+5)+2a} , ^(2n+2)(l-l/p)jp(l-a/6) _ 

Because p < 1, we easily see that /Lt<$ < 0. Moreover, 

K ° = -T-rA^ 2n + 2)(- - 1) + a} < 0. 
1-/3 p 

From this, we get k$ < for <5 small enough. Therefore we have 

S 2 < R M + log(R + l)R Ks < 1. 
Case (m): Suppose i? < 1. We see that min(l, (_R2-?'(/ 3 - 1 )0+ 1 ))) = i?2^' 3 - 1 H s + 1 )and $535$ becomes 

(5.29) Y] * /||f o/6 • /| (1 ~ a/b) < {2J("-«/ 3 ) j R( 2n + 2 )( 1 / 2 -i/p)}pa/'> 

| 2 j( 2 ™+ 2 )(l/p-l+<5)+a^( 2 ™+ 2 )(l-^) . (^2-?( /3 - 1 ))( ;i + :L )}^ 1 - a / b ). 

Because the power of 2 J is negative, provided <5 is small enough, we get 

(5.30) V * /lir 76 • if (1_a/&) < #( 2 "+2)(l/2-l/p)£i . i? {(2n+2)(l-i) + ( S +l)}p(l-f ) 

=: 

Observe that 

/i = (2n + 2)(1 - -) + (s + 1) = (2n + 2)(1 - -) + f[(2n + 2)(- - 1)] + 1) > 0. 
P P P 

Thus we have fig > for 5 small enough. Now we get 

\\ L i * f^ a/b ■ il {l ~ a/h) < R ws < 1. 

We then conclude that S2 < 1. The proof is complete. □ 
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We now establish the same result for the case (3 > 1. 

Theorem 5.4. Forl<(3,p< I, if (i - l)(2n + 2)fi + a < 0, the operator T^ a „ is bounded on 
H p space. 

Proof. By arguing as in f|5.14[) (|5.1 T[) in the proof of Theorem 15.31 to obtain the following 

(5.31) E 11^ * /Hk ^E 11^ * f\\" a/ " ■ Il /2(l - a/b) + £ WL, * f\\?' b • 7 |/2Ci-a/6) ) 

j>i j>i j>i 

where 1\ and I2 are defined as in (|5.16l) . Because the estimate for I\ is exactly same with the proof 
of Theorem 15. 3[ we only deal with l-i- As before, we have 

(5.32) 



£ * f\\2 /b ■ /| (1_a/b) < |2J'(«-»' 3 )^( 2n + 2 )( 1 /2-l/p)|a/6 



.| 2 j{(2n+2)(l/p-l+5)+Q} i? (2ri+2)(l-i) ^ (13- 1) ) (s+l) | (1 -a/6) 



Case (i): Suppose i? > 1. As for the case (3 < 1, wc have I2 = if 2- 7 < i? and we only need 
consider j with 2 J > i?. Since i?2 J (' 3_1 ' > 1, we estimate I2 as 

j 2 < 2 i{2(2n+2)[l/p-l+5]+2a} i? 2(2n+2)(l-l/p)^ 

Note that 

(5.33) (2n + 2)(- - 1) + a < (2n + 2)(- -l)0 + a<O. 

P P 

Thus, if 8 is sufficiently small, we have (2n + 2)(l/p — 1 + S) + a < and we can sum (|5.32p as 

(5.34) W L 3 * /fir 7 ' ' /| (1_a/b) < #(2«+2)(V2-Vp)¥ . J? {(2"+2)(l-i)}p(l-f) < ^ 

where the last inequality holds because p < 1 and J? > 1. 

Case (ii): Suppose R < 1. From (|5.33p . using (1) in Lemma |5. II we have 

E II L i * /ll2 Q/b ' ll p[1 ~ a/b) < RP^ + I logi?| R PKS , 

where 

(5.35) i? w = i?( 2n+2 )( 1 /2-l/p)f . ^{(2n+2)(l-l/p)+( s +l)}(l-f) ) 

r k 6 _ jj(2n+2)(l/2-l/p)f _ j^T^{(2ri+2)(l/p-l+o)+a}^(2n+2)(l-l/p) jl-a/f^ 

Observe that 

Ai = (2n + 2)(1 - -) + (a + 1) = (2n + 2)(1 - i) + [(2n + 2)(- - 1)] + 1 > 
p p p 

and 

K ° = t\^ 2ji + 2 )(VP -!) + «} + (2n + 2)(1 - 1/p) = -r^—Amn + 2)(- - 1) + a} > 0. 
1 — p 1 — p p 

Therefore we have /z ,/« > for 5 small enough, and so 

(5.36) \\L ] * f\\ a 2 /b ■ q {1 - a/b) < RPs + j iogi?| • R K « < 1. 

Now we conclude that £2 < 1 from (|5.34[) and (|5.36l) . The proof is complete. □ 



6. Necessary conditions 

In this section we show that the Hardy space boundedness obtained in the previous section is 
sharp except for the endpoint cases. We only give an example for Theorem 15.21 Examples for the 
other theorems can be found similarly. We refer to Sjolin [TO] for the Euclidean case. 
We let g(x) a function such that 



J x a g{x)dx = for < a < k and J x k+1 g(x)dx ^ 



0. 



Let h(x2, • ■ • , X2n, X2n+i) & function supported on the ball B(0, 1) such that J" R2 „ h ^ and let / 
be the function on R 2n+1 defined by f(x lt x 2n +i) = g(x 1 )h(x 2 , ■ . ■ , x 2n+ i)V(xi, • • • ,x 2n+1 ) 6 
M 2n+1 . Then 

x a f(x) = 0, if |a| < k. 

For e > set f t {x) = e -( 2 ™+ 2 )/p/(|). Wc note that ||/ e ||j?«> = C for all e > 0. Assume that 
T Kafj is bounded on H p . Then \\T Ka lj {f t )\\ HP < 1. Note that \y\ < e for y € supp(/ e ). Then, for 
|x| > Ce with a large constant C > 0, we have 



@.h)f(x) = J K(xy- l )f € {y)dy 



[[Kixy- 1 )- Y, ^D a K(x)yA f c (y)dy + [ I £ ±D a K(x)y<* ] f e (y)dy 

\ \a\<k+l ' J \|a|<fc+l °" J 



(6.2) 

(6.3) = J D k +*K(xy^)0(y k + 2 )f e (y)dy + CB% l K(x) J y k+1 fMd Vl , \y m \ < \y\ < e 

= o(e (2n+2)+k+2 ~ i2 ^ 1 | x |-(»+"+(fc+2)(/3+i))) + e k+l+(2n+2) -^T^d k+1 K(x). 

Take K(x) = \x\- 2n - 2 - a ^ x \'\{x). We see that \d k + l K(x)\ ~ \ x \-^+2)- a -{k+i){p+x) for gmall 
x. For e < we have 

e (2 ra +2)+fc+2-2^| a .|-(2n+2+a+(fe+2)(/9+l)) < £ (2n+2)+(fc+l)-fi^i | a; |-(2n+2)- Q -(fc+l)(/3+l)_ 

Therefore we get 

K a3 * f e ( X ) ~ £ (2™+2) + fe+l-^ N -(2„ + 2)-a-( fc+ l)(/m) for ^ > £ l/(/m)_ 

Then, 

(6.3L)> / |X^*/ e (a;)| p ( ia ; >e p ( 2 " +2 )+ fcp+p -( 2 " +2 ) / | a .|-(2n+2) P -a P -(fc+i)Cfl+i)P da . 

(6.5) > £ p(2r t +2)+fcp+p-(2ri+2) £ ^ (2 " +2) ^^ 2 1 " +2) + ° p -(fc+l)p 

= e ^[(f-l)(2«+2)/3+a]. 

This implies that (1 — ^)(2n + 2)f3 + a must be < 0. This shows that Theorem l5.2l is sharp except 
the endpoint case (1 — j)(2n + 2)/3 + a = 0. 
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